A Minimum Relative Entropy Principle for Learning and Acting
نویسندگان
چکیده
منابع مشابه
A Minimum Relative Entropy Principle for Learning and Acting
This paper proposes a method to construct an adaptive agent that is universal with respect to a given class of experts, where each expert is designed specifically for a particular environment. This adaptive control problem is formalized as the problem of minimizing the relative entropy of the adaptive agent from the expert that is most suitable for the unknown environment. If the agent is a pas...
متن کاملA minimum relative entropy principle for AGI
In this paper the principle of minimum relative entropy (PMRE) is proposed as a fundamental principle and idea that can be used in the field of AGI. It is shown to have a very strong mathematical foundation, that it is even more fundamental then Bayes rule or MaxEnt alone and that it can be related to neuroscience. Hierarchical structures, hierarchies in timescales and learning and generating s...
متن کاملThe Estimation of Distributions and the Minimum Relative Entropy Principle
Estimation of Distribution Algorithms (EDA) have been proposed as an extension of genetic algorithms. In this paper we explain the relationship of EDA to algorithms developed in statistics, artificial intelligence, and statistical physics. The major design issues are discussed within a general interdisciplinary framework. It is shown that maximum entropy approximations play a crucial role. All ...
متن کاملThe Factorized Distribution Algorithm and the Minimum Relative Entropy Principle
Estimation of Distribution Algorithms (EDA) have been proposed as an extension of genetic algorithms. In this paper the major design issues of EDA’s are discussed using an interdisciplinary framework, the minimum relative entropy (MinRel) approximation. We assume that the function to be optimized is additively decomposed (ADF). The interaction graph GADF of the ADF is used to create exact or ap...
متن کاملA Local Entropy Minimum Principle for Deriving Entropy Preserving Schemes
Abstract. The present work deals with the establishment of stability conditions of finite volume methods to approximate weak solutions of the general Euler equations to simulate compressible flows. In oder to ensure discrete entropy inequalities, we derive a new technique based on a local minimum principle to be satisfied by the specific entropy. Sufficient conditions are exhibited to satisfy t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Artificial Intelligence Research
سال: 2010
ISSN: 1076-9757
DOI: 10.1613/jair.3062